Frame Rate Up-conversion Using HOE (Hierarchical Optical flow Estimation) Based Bidirectional Optical Flow Estimation
نویسندگان
چکیده
We propose a frame rate up-conversion algorithm using bidirectional optical flow estimation at each pixel based on a previously proposed Hierarchical Optical flow Estimation (HOE) algorithm. The HOE is extended from unidirectional flow estimation to bidirectional flow estimation in which a 3×3×2 multi-dimensional filter and a motion compensated image method are used for high accuracy of flow estimation. PSNRs of 30.29–45.99 dB were obtained for five test sequences with computer simulations. The PSNR improvements are 3.50–10.99 dB compared to a simple bidirectional block matching method and 0.26–1.88 dB compared to an existing method based on a bidirectional block matching method.
منابع مشابه
Optical flow estimation using high frame rate sequences
Gradient-based optical flow estimation methods such as LucasKanade method work well for scenes with small displacements but fail when objects move with large displacements. Hierarchical matching-based methods do not suffer from large displacements but are less accurate. By utilizing the high speed imaging capability of CMOS image sensors, the frame rate can be increased to obtain more accurate ...
متن کاملAccuracy of Gradient-Based Optical Flow Estimation in High-Frame-Rate Video Analysis
This study investigates the effect of frame intervals on the accuracy of the Lucas–Kanade optical flow estimates for high-frame-rate (HFR) videos, with a view to realizing accurate HFR-video-based optical flow estimation. For 512×512 pixels videos of patterned objects moving at different speeds and captured at 1000 frames per second, the averages and standard deviations of the estimated optical...
متن کاملMotion Compensated Frame Interpolation with a Symmetric Optical Flow Constraint
We consider the problem of interpolating frames in an image sequence. For this purpose accurate motion estimation can be very helpful. We propose to move the motion estimation from the surrounding frames directly to the unknown frame by parametrizing the optical flow objective function such that the interpolation assumption is directly modeled. This reparametrization is a powerful trick that re...
متن کاملResolution Enhancement by Incorporating Segmentation-based Optical Flow Estimation
In this paper, the problem of recovering a highresolution frame from a sequence of low-resolution frames is considered. High-resolution reconstruction process highly depends on image registration step. Typical resolution enhancement techniques use global motion estimation technique. However, in general, video frames cannot be related through global motion due to the arbitrary individual pixel m...
متن کاملNext-Flow: Hybrid Multi-Tasking with Next-Frame Prediction to Boost Optical-Flow Estimation in the Wild
CNN-based optical flow estimation has attracted attention recently, mainly due to its impressively high frame rates. These networks perform well on synthetic datasets, but they are still far behind the classical methods in realworld videos. This is because there is no ground truth optical flow for training these networks on real data. In this paper, we boost CNN-based optical flow estimation in...
متن کامل